Portland Linux/Unix Group Advanced Topics Meeting Announcement

Who: Nathan Williams
What: Using Mozilla's Heka project for log and event stream processing
Where: Free Geek, 1731 SE 10th Avenue, Portland (Left Entrance)
When: Tuesday, August 18th, 2015 at 7pm
Why: The pursuit of technology freedom
Stream: http://pdxlinux.org/live/

Talk: A Practical Introduction to Scalable Stream Processing with Heka and how the log and event processing system at Treehouse has evolved from a typical Elasticsearch/Logstash/Kibana setup into a Heka-based system. We will also discuss the why behind this move and where we are headed.

Heka is an open source stream processing software system developed by Mozilla. Heka is a “Swiss Army Knife” type tool for data processing, useful for a wide variety of different tasks, such as:

• Loading and parsing log files from a file system.

• Accepting statsd type metrics data for aggregation and forwarding to upstream time series data stores such as graphite or InfluxDB.

• Launching external processes to gather operational data from the local system.

• Performing real time analysis, graphing, and anomaly detection on any data flowing through the Heka pipeline.

• Shipping data from one location to another via the use of an external transport (such as AMQP) or directly (via TCP).

• Delivering processed data to one or more persistent data stores.

https://github.com/mozilla-services/heka

Nathan is a sysadmin by trade who's been into Linux, automation and data for the last 10 years and is currently working at Treehouse as a systems developer.

Many will head to the Lucky Lab at 915 SE Hawthorne Blvd. after the meeting.

Rideshares Available

PLUG is open to everyone and does not tolerate abusive behavior on its mailing lists or at its meetings.

PLUG Advanced Topics

Informal meeting at the Lucky Lab NW.